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STATSMBHT  OP  PROBLEM 

Within  the  past  eight  years  some  few  educators  have 
busied  thesuselTes  with  a  probleoi  too  long  slighted —  that 
of  providing  students  vith  an  immediate  knowledge  of  the 
rightness  or  wrongness  of  their  responses—  aiwi  have  set 
about  to  investigate  the  problem,  apply  to  it  the  laws  of 
aental  activity,  and  develop  devices  and  techniques  as  a 
■eans  of  carrying  out  their  beliefs.   In  so  far  as  the 
writer  Icnows,  no  one  has  compiled  a  list  of  their  achieve- 
ments or  attempted  to  draw  frora  their  patient  innovations 
a  eerablanee  of  form  and  order.  It  is  the  writer's  inten- 
tion, (!)  to  discuss  briefly  the  chief  devices  and  tech- 
niques irtiich  have  been  developed  to  foster  iiaziediate  cheelc- 
up,  (2)  to  point  out  the  findings  of  those  iriio  have  con- 
ducted investigations  into  the  beneficial  effects  of  an 
iaaiediatd  check-up  and,  (3)  to  present  his  own  findings 
froni  an  experimental  investigation  into  the  value  of  an 
JUoMdiate  knowledge  of  the  rightness  or  wrongness  of  a 
response  as  eaployed  in  a  aethod  of  teaching  by  distrib- 
uted reviews. 


*1 

n 
1 


1 


HISTORICAL  SURVEY  OP  TESTING  AND^SC0RIM3-  DEVICES 

S.  L.  Preaaey  (23)  has  pointed  out  that  education  la 
the  one  major  activity  which  has  thus  far  failed  to  employ 
syateraatic  ingenuity  to  the  solution  of  its  problems. 
Like  other  sciences,  its  development  can  be  no  faster 
than  the  development  of  its  means  of  aeasureaent  and  the 
development  of  its  instruments. 

While  Industry  has  been  utilizing  the  machine  to  re- 
move the  monotony  of  its  labors,  educators  have  £^one  on 
with  the  routine  of  their  offices,  spending,  needless  hours 
daily  correcting  tests  when  they  might  have  been  spared 
the  monotony  with  increased  accuracy  of  results  and  might 
more  profitably  have  employed  their  time  in  actual  teach- 
ing. And  hot  only  are  tests  time -consumers —  even  the 
objective  ones  are  wasteful  since  they  can  be  used  but 
once , 

When   Stone  introduced  the  separate  answer  sheet 
eleven  years  ago  in  connection  with  his  reading  tests,  he 
opened  the  way  to  test  economy  and  offered  an  opportunity 
to  do  away  with  the  page  turning  necessary  to  the  location 
and  correction  of  answers.  He  made  possible,  as  well,  con- 
venient filing  of  test  results  apart  from  the  bulky  test 
pamphlets. 
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Since  the  Introduction  of  the  separate  anaver  aheet, 
has  conie  the  deTelopaent  of  testing,  scoring  and  ioaadi« 
ate  check-up  devieea.  That  they  hare  not  dSTeloped  towards 
any  one  goal  by  utilizing  progressively  the  oontrihutioiui 
of  others  will  be  evident  from  the  historical  survey  of  the 
devices  *iich  the  irriter  offers.  To  hia  it  is  quite  rea- 
sonable to  assuae  that  the  inventors  have,  in  the  anla^ 
worked  ii^ependently—  apparently  not  aware  of  aore  than  a 
few  of  the  previous  costpeting  educational  Instniaents.  It 
is  the  hope  of  the  writer  that  his  brief  descriptions  of 
the  devices  employed  to  the  date  of  his  writing  will  be  of 
Mate  value  to  laborers  in  the  field  of  testing  and  scoring, 
by  drawing  their  attention  to  what  has  been  devised  before 
thmi* 

C.  E.  Lauterbaeh  (9)  patented  an  educational  test 
sheet  in  I926  which,  though  it  failed  to  use  a  separate 
answer  sheet,  was  a  step  towards  simplification  and  speed 
in  scoring.  The  five  alternative  answers  p9r  question 
were  designated  by  numbers  in  close  columns  on  the  right 
of  the  sheet.  The  testee  made  his  choice  of  the  answers 
by  crossing  out  the  corresponding  number.  Upon  the  com- 
pletion of  the  test  the  student  corrected  his  own  (or  an- 
other student's  paper)  by  placing  a  stencil  key  over  the 
answers  so  that  openings  registered  with  the  numbers  on 


the  t«8t  sheet  z^presentlng  the  correct  responses.  The 
unatoer  of  cross-aarks  visible  thus  qulcldy  Iseca-ae  the 
score. 

In  1927  T.  B.  Thompson  (26)  patented  the  first  self- 
checlclng  device.   Its  rather  heavy  wooden  frame  held  In 
pXaee  a  trlple»plj  annangesient  consisting  of  a  data  sheet 
vlth  its  problem  and  ansver  location  openings  superimposed 
over  a  work-sheet.  Dlrectlj  under  the  work-sheet  a  cheek- 
sheet  was  placed,  so  designed  that  openings  were  provided 
under  the  Incorrect  answers.  The  pupil  made  his  choice  of 
the  alternative  answers,  which  were  indicated  by  number 
positions  on  the  data  sheet,  by  pressing  his  pencil  point 
through  the  holes  which  corresponded  to  his  conception  of 
the  correct  problem  answers.  Hhen  his  selections  were 
correct  the  pencil  passed  through  the  openings  of  the  data 
sheet  and  slightly  through  the  work-sheet  before  ctMaing  up 
•gainst  the  correct  answer  stops,  otherwise  it  pezMtrated 
all  three  layers  of  the  device.  Consequently  the  depth  to 
which  the  pencil  registered  was  an  lanediate  indication  of 
%l»   rlghtness  or  wrongness  of  the  response,  and  the  work- 
sheet became  something  of  a  penuugient  record  of  the  test 
results. 


Two  years  later  the  Clapp-Young  3elf-5Iariing  Testa  (3) 
out,  Ingenuously  applying  a  separate  folder  for  an- 
swers in  such  a  way  that  by  checking  a  square  on  page  one 
corresponding  to  an  alternative  of  the  aultiple-ohoiee 
answers,  use  was  made  of  a  carbon  strip  on  page  three  to 
record  a  print  on  page  two.   If  the  carbon  cross  fell  in 
the  ans'srer  square  directly  behind  the  original  response 
(that  is,  on  page  two)  the  answer  was  correct.  If  the  cross 
fell  outside  the  square  the  answer  was  incorrect.  The 
Clapp-Young  answer  sheet  was  also  a  forward  step  in  test- 
ing in  that  the  alternative  positions  for  the  whole  test 
p««5^1et  were  closely  grouped  on  but  two  sides  of  the  four 
page  answer  folder—  thus  preventing  much  page  turning. 

f.  B,  Knight  (7)  has  developed  a  test  sheet  having  a 
row  of  spaced  questions  on  one  side  and  a  siailar  row  of 
answers  on  the  reverse  side—  the  questions  and  answers 
being  offset  longitudinally  to  permit  the  sheet  to  be  fold- 
ed progressively  froa  one  edge  towards  the  other  in  order 
to  bring  the  answers  adjacent  to  the  corresponding  row  of 
questions.  With  the  device  it  is  also  possible  to  prepare 
a  space  next  to  the  question  for  the  pupil *s  answer,  and  on 
the  reverse  side  a  spaee  adjacent  to  each  answer  for  a  sec- 
ond trial.  A  variation  of  the  test  sheet  pertaits  the  paper 


to  b9  folded  progreaslTely  frora  the  "oottoa  to  the  top  la 
order  to  bring  the  aneirere  to  the  questions,  whleh  are 
written  on  the  reTerae  side  of  the  sheet,  adjacent  to  the 
pupil's  ansirer,  or  adjaeent  to  the  question  If  desired. 
Thus  test  scoring  Is  faellltated  and  self-checlilng  Is  pos- 
sible. 

Quite  different  is  the  dOTlee  ivhlc^  S.  O.  Bondeson  (1) 
prepared  for  testing  students  In  arithmetic.  It  provides 
for  an  enrelop  containing  a  plurality  of  openings  through 
whleh  the  pupil  writes  the  answers  to  the  problems  adja- 
cent to  the  openings.  Behind  the  sheet  upon  which  the 
answers  are  written  Is  a  sheet  of  cardboard  to  facilitate 
the  Insertion  and  reaoyal  of  the  paper,  as  well  as  to  af- 
ford an  adequate  writing  surface.  As  soon  as  a  pupil  com- 
pletes a  sheet  It  is  reniovod  to  peralt  the  other  sheets 
within  the  envelop  to  be  exposed  successively  to  the  new 
students  to  whom  the  envelop  Is  passed.  fh»   sheets  of 
responses  are  plaoed  within  a  Itey  envelop  which  allows  the 
pupil's  answers  to  appear  through  windows,  adjacent  to 
which  are  the  conrect  answers  to  the  probleias.  Qulei  coia- 
parlsons  are  possible  and  the  scores  are  readily  obtained. 
As  each  paper  Is  corrected  it  Is  removed  and  the  other 
sheets  appear  succeosively  adjacent  to  the  openings. 
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Brownlee  and  Michner  (a)  copyrighted  a  separate  an- 
ewer  sheet  consisting  of  an  envelop  containing  a  stop 
sheet.  The  upper  face  of  the  envelop  has  rows  of  squares — 
each  row  representing  a  question  and  each  square  an  alter- 
native answer.   If  the  student  thinks  that  answer  two  is 
correct,  he  cuts  down  the  side  and  across  the  bottom  of 
square  two  by  pressing  with  a  needle  against  the  paper. 
He  then  turns  the  square  upwaxHi  and  if  the  answer  is  cor- 
rect he  finds  a  mark  on  the  back  of  the  square.  If  the 
student  fails  to  obtain  the  correct  answer  on  the  first 
attempt  he  tries  the  next  most  likely  answer—  proceeding 
until  he  achieves  the  desiired  response. 

A  loachine  called  Krexit  has  been  designed  by  J.   E. 
Roberts  (b)  to  mark  the  correct  answers  of  objective  tests. 
A  card  is  provided,  containing  squares  numbered  to  corre- 
spond to  each  of  the  one  hundred  multiple  answer  questions 
and  the  testee  checks  the  squares  which  he  thinks  repre- 
sent the  correct  answers.  The  machine,  which  has  been  set 
to  register  the  correct  answer  locations,  marks  the  proper 
squares  on  the  card  with  a  red  circle.  Such  a  device 
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(a)  Published  by  the  inventors,  Wichita,  Kans,  c.  t930 

(b)  Produced  by  the  Educational  Machine  Co., Point  Marion, Pa. 


quloJcly  shows  the  student  the  point  of  eirror  as  well  as 
what  the  desired  response  should  have  bean. 

A  device  for  self -scoring,  much  aiailar  to  that  In- 
vented by  T.  E,  Thompson,  has  been  devised  by  J,  A.  Wiley 
(,?3).  Its  top  plate  is  perforated  in  rows  and  ooluans  and 
oonneoted  periphez*ally  on  three  edges  to  the  bottoa  plate. 
The  envelop  thus  formed  receives  two  slides,  one  harlng 
holes  similar  to  the  surface  plate  and  the  other  having 
fewer  holes,  so  arranged  that  openings  occur  below  the  cor- 
rect answers  and  stops  below  the  incorrect*  A  punoturable 
sheet  is  folded  about  the  upper  slide--  the  fold  inward. 
The  two  slides  are  then  pressed  within  the  envelop  and  the 
student  tests  his  answers  by  pressing  with  a  stylus  upon 
the  opening  corresponding  to  the  number  of  the  raultiple- 
oholoe  answer  which  he  taltos  to  be  ooi*rect.  He  is  iiaae- 
diately  inform'id  as  to  the  rightness  or  wrongness  of  the 
response,  for  the  stylus  will  penetrate  farther  when  the 
answer  is  correct  than  when  it  is  incorrect.  In  case  he 
punches  the  wrong  hole  he  re-reads  and  re-punches  as  often 
as  necessary.   It  is  obvious  that  different  stop-slides 
may  be  used  to  provide  for  different  patterns  of  correct 
responses. 
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Among  the  teat -scoring  devices  by  S.L.  Pressey  is  the 
•*Pocket  Tester  and  Scoring  Comer"  (23),  the  answer  unit 
of  ifhlch  is  a  eard  containing  a  square  for  each  of  the  nua-» 
l>ered  questions.  The  pupil  writes  the  nunbers  of  the  al- 
tomatlve  answers  which  he  considers  to  be  correct  within 
the  proper  squares  and  the  card  is  then  pressed  between  two 
stencils  which  are  closed  on  the  left  and  bottoa  edges. 
The  scoring-comer  stencils  h&we  windows  corresponding  to 
the  answer  squares  and  the  correct  answers  are  aartced  upon 
the  stencils  at  the  side  of  each  window.  Scoring  then  be- 
co3ie«  a  natter  of  comparison  of  answers  and  of  totaling  the 
findings. 

Pressey  has  also  devised  a  aachlne  (20)  which  autoaat* 
Ically  corrects  and  scores  tests.  The  testes  sits  before 
the  machine,  reading  the  questions  and  alternative  answera 
through  a  window.  For  each  question  he  decides  the  nuaber 
of  the  nttltlple  choice  answer  which  he  thlnis  is  correct  and 
presses  the  correspondingly  numbered  key  at  the  right  of 
the  window.  By  so  doing  he  aarfes  his  choice  and  rotates  a 
dnm  which  acres  his  test  sheet  up  to  a  new  question.  On 
the  back  of  the  laachlne  a  record  Is  oade  of  the  correct  re- 
sponses. With  this  dewiee  it  is  possible,  when  teaching, 
rather  than  testing  is  desired,  to  aore  a  lever  which  holds 
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the  dniai  until  the  proper  key  has  been  pressed.  The  stu- 
dent will  then  know  iaaediately  the  correctness  or  incor- 
rectness of  his  reaionse  by  observing  the  question  on  the 
drum.  If  he  falls  to  aove  the  question  his  answer  is  vrong. 
Accordingly,  he  re-reads  and  re-tries  until  he  aakes  the 
proper  response. 

Two  years  later  Pressey  (21)  further  developed  his 
■achine  to  provide  for  autoaatic  drill  in  probloia  solving. 
The  action  of  the  machine  renained  the  saae,  axcept  that  a 
new  release  automatically  oaitted  a  question  from  further 
presentation  after  a  subject  obtained  the  correct  answer 
twice  in  succession.  The  subject  was  instructed  to  con- 
tinue his  attempts  at  the  correct  answers  while  the  test 
revolved  about  the  drum  aa  often  as  necessary,  autonatical- 
ly  dropping  each  question  after  two  successive  correct  re- 
sponses had  been  achieved. 

Still  a  different  aiachine  (23)  has  been  developed  by 
the  same  inventor—  a  machine  which  scores  tests  and  tab- 
ulates them  by  item.   It  uses  an  answer  plate  consisting  of 
two  duplicate  ostal  steneils  which  ezis&ge  over  typewriter 
paper  when  pressed  together*  Students  indicate  their  an- 
swers by  pressing  a  pencil  through  the  squares  in  %h9  aetal 
plates  which  correspond  to  the  alternative  answex*s  taken  to 
be  correct  for  the  probleas.  The  answer  plates  are  tiien 
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run  tlirough.  a  machine  which  provides  for  projecting  pln» 
oorpespondlog  to  the  correct  answer  holes.  The  pins  are 
seated  upon  light  springs  which  cause  them  to  project 
through  the  inxnched  holes,  bat  to  remain  depressed  by  the 
paper  if  the  holes  are  not  punched,  A  carrier  moves  over 
the  pins  and  the  pins  strike  an  item  counter  to  rotate  a 
counting  rachet  one  unit  per  pin —  the  result  is  a  total 
of  the  number  of  correct  answers,  A  further  application 
of  the  aachine  aar^a  the  positions  of  the  correct  answers 
which  have  not  been  punched.  Still  another  feature  of  the 
device  is  the  running  total  of  those  who  have  responded  to 
the  answers  correctly,  Pressey's  machino  operates  as  rap* 
idly  as  one  ean  swing  the  counter  baci  and  forth. 

Without  question  the  greatest  number  of  devices  for 
test  correction  and  learning  guidance*-  and  those  destined 
to  be  most  far  reaching  in  significance-*  are  those  devel- 
oped recently  by  H.  J.Peterson  and  J.  C.  Peterson.  One  of 
their  earliest  devices  is  a  oechanical  ** 3 elf- Instructor 
and  Tester"  (14)  consisting  of  an  opaque  envelop  with  rows 
and  columns  of  circles  printed  upon  the  surface--  each  row 
representing  a  question  and  each  circle  in  the  row  one  of 
the  alternatives  of  the  maltiple-choiee  answers.  A  hard, 
tough  selector  sheet  vith  perforations  so  arranged  that 
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they  aro  located  directly  beneath  the  clrclea  on  the  en- 
yelop  which  represent  the  correct  responses,  fits  snuggly 
within  the  enrelop.  On  each  side  of  the  selector  sheet 
is  glued  an  intaniediate  perfoi^ted  sheet  having  a  hole 
for  each  circle  on  the  tester  aurfiice.  On  each  aide  of 
the  selector  sheet  is  placed  a  colored  sheet  of  light- 
weight paper  which  serres  to  prevent  the  pupil  frw«  cheat- 
ing by  holding  the  device  against  the  light  to  determine 
the  location  of  correct  answer  spots  and  serves,  as  well, 
as  a  permanent  record  of  the  score.  To  operate  the  device 
the  pupil  presses  a  pin  through  the  ciircle  on  the  envelop 
which  corresponds  to  his  selection  of  the  alternative  an- 
swers. Then  the  answer  is  incorrect  the  pin  passes  through 
one  of  the  worli-sheets  and  one  of  the  intermediate  perfo- 
rated sheets  to  ecsMi  to  a  stop  against  the  selector  sheet. 
When  the  answers  are  correct  the  pin  passes  entirely 
throt^  the  device.  It  may  readily  be  seen  that  when  the 
OMiohanical  self-tester  is  desired  as  a  teaching  device 
the  pupils  nay  be  instructed  to  re-read  and  re-try  upon 
tiM  event  of  a  wrong  initial  z*esponse  and  proceed  simi- 
larly until  they  gain  a  correct  answer. 

The  Che3o»Score  device  (H),  by  the  ssas  inventors, 
has  several  forms —  yet  in  every  ease  tlie  saae  principle 
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ia  etaployed:  the  alten»tlTO  ansirera  (or  characters  rep- 
re  sent  Ing  them)  are  treated  chemically  In  two  inlcs  of  iden- 
tical appearance  \rhlch,  irtien  moistened  or  treated  with  a 
thljrd  che-alcal,  stand  out  stri:clnsly  in  different  colors  to 
notify  the  student  of  the  correctnesss  or  Incorrectness  of 
his  response.  In  one  fora  the  alternative  answers,  spots 
preceding  the  alternative  answers  -^  lines  under- seoriag 
them,  are  treated  chemically  with  invisible  InJcs  capable  of 
belnc  l>roaght  out  ch9-5lef;.lly  into  contrasting  colors  Toy   the 
chemical  or  moisture  in  an  absorhant  strip  comprising  the 
core  of  a  Chemo-pen.   In  another  form--  and  probably  the 
form  adapted  to  widest  usage—  a  sej»rate  answer  sheet  la 
treated  chealcally  so  that  characters  In  rows  and  eoluami 
represent  the  alternatives  of  aultlple-cholce  or  true-false 
answers.  The  Cheao-Score  device  may  be  used  for  teaching, 
rather  than  for  testing,  purposes  by  instructing  the  pupil* 
to  re-read  and  re-try  in  the  event  of  their  falllnr  to  se- 
cure the  correct  color  response  upon  the  first  at    : — 
and  proceeding  similarly  until  they  arrive  at  the'  proper 
answer. 

The  originators  of  the  Chemo-Score  deriee  bars  applied 
their  invention  to  pronunciation  teats  (t9)t  psyehologlcal 
teats  (12)  and  reading  tests  (13)  in  varied  foraa —  oas  <tf 
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which  laakos  the  teat  re-usable  to  the  extent  of  the  iwaifeap 
of  its  detachchle  stripe,  and  ladafinltsly  beyond  that  tiat 
by  the  employment  of  Perfo-Score  r.nsirer  sheets.  Since  eac^ 
strip  carries  eheaically  t2reat9c  spots  rapressnting  ths  al- 
ternative snsweris  for  the  entire  test,  the  test  aay  be  given 
to  anotiisr  person  after  the  strip  is  removed,  or  it  say  b« 
used  for  study  purposes  with  each  strip  constituting  a  re- 
view. 

Further  evidence  of  the  flexibility  of  the  Cheao-3cor« 
technique  is  demonstrated  in  the  distributed  review  worlE- 
booics  of  the  writer.  In  his  applications,  chemically  treat- 
ed spots  above  the  horizontally  spaced  alternative  answers 
are  visible  in  controlled  fashion  by  the  use  of  stencil  Joey- 
cards,  The  previous  results  of  study  remain  after  the  al- 
ternatives are  attempted  and  aelf-eraulation  is  accordingly 
promoted, 

Quite  slallar  to  the  Cheao-Score  device  Is  the  Therao- 
Score  device  (H)  by  the  saaw  Inventors.   It  consists  of 
chemically  ti?e&ted  test  sheets  or  separate  answer  sheets  of 
the  saoe  seaeral  nature  as  the  previously  described  device— 
except  that  heat,  rather  than  a  third  chealcal,  brings  out 
%h»   eolor  reactions. 
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In  1932  J".  C.  Peter?-      ..  J.  Petersoa  copyrighted 
their  "Perfo-Score  Answer  Sheet"  {\3)   ^hich  has  raanj  of 
th9  advantages  of  previoualy  mentioned  scoring  devices  and 
an  additional  advantage  of  being  alaost  ne£;;ligible  in  cost. 
2feimt)ers  or  characters  representing  the  alternatives  of 
multiple -choice  or  true-false  answers  ajre  spaced  in  rows 
which  correspond  to  the  questions  or  probletns.  If  th» 
student  considers  the  third  alternative  answer  to  be  the 
correct  one  for  r^'oblen  number  trro  he  draws  a  circle  a- 
round  that  chi.racter.  Upon  the  coapletloi  of  the  test 
the  various  papers  are  collected  and  stacked  upon  b.   peg 
board--  the  pegs  of  which  fit  into  holes  in  the  aargina 
of  the  sheets  to  hold  them  firmly  in  aligniient.  The  teach- 
er corrects  the  papers  by  placing  a  Jwy  sheet  (-nerely  a 
Pex^o-Score  sheet,  as  before,  with  the  proper  answers  niarS:- 
ed)  ugon   the  peg  board  and  then  pressing  an  awl  through  the 
correct  answer  locations.  In  this  way  fifty  or  more  eheete 
nay  be  scored  simultaneously  and  so  quicl^ly  that  the  test 
reeults  aay  be  returned  to  the  pupil  iaiBediately  after  the 
examination.  Such  a  rapid  testing  proceeduire  coaparss  fa- 
Toi^bly,  in  its  educational  advantages,  to  the  iaaediate 
check-up  which  is  possible  when  the  <Jheao-3core  device  is 
used. 
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A  farther  doTolopaeat  of  the  aaa*  Idea  resulted  in  the 
"AaXtiple  Perforator"  (16)—  a  aaohiae  which  recelTes  fifty 
OF  aore  sheets  slaiultaneously,  holds  the:3  carefully  Into  a 
stack  alignment  and  perforates  all  of  the  correct  answer 
positions  in  the  staelc  with  one  strolce  of  a  lerer.  It  is 
possible  to  adjust  the  machine  to  aceomaiodate  any  giren  ar- 
rangesient  of  answer  positions  desired, 

H*  J.  Peterson,  3,  C,   Peterson  and  H.  R.  Rigginbottoa 
have  Inyented  an  electro-score  device  (t6)  i^ich  scores  a 
separate  answer  sheet  eleotrieally,  sartcs  the  correct  an- 
swers and  stamps  the  total  score  upon  each  paper.  The  an- 
swer sheet  differs  from  the  Perfo-Score  answer  sheet  only 
in  that  the  altematiwe  characters  are  pairs  of  ^uares 
which  have  been  stamped  with  an  electrically  conducting 
ink.  The  pupil  connects  the  |»ir  of  squares,  which  coz're- 
sponds  to  his  choice  of  the  alternative  answers,  with  a 
lead  pencil  line.  The  paper  is  then  scored  by  feeding  it 
into  the  aaehine.  Mechanical  contacts  drop  upon  the  squares 
Which  represent  the  correct  answers.  When  a  line  connects 
these  squares  an  electrical  circuit  is  aade  across  the  car- 
bon line  and  the  device  registers  a  unit  change  upon  the 
counter  niechanlsa.  The  total  score  is  autoaatically  stamp- 
ed upon  each  sheet. 
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Another  type  of  electrical  test  corrector  called  the 
"Markograph"  (c)  is  now  available.   It  utilizes  a  separate 
answer  sheet  in  which  numbered  semicircles  are  cut  free 
except  for  tha  diameter  lines.  These  semicircles  corre- 
spond to  the  alternatives  of  multiple -choice  answers  and 
the  selection  of  the  answers  is  made  by  folding  back  the 
representative  semicircle.  The  sheet  is  then  put  within 
the  correcting  machine  and  each  correct  answer  registers 
aj  a  light.  Since  electrical  contacts  are  placed  over  the 
correct  holes,  a  dial  can  be  made  to  register  the  total 
score, 

L,  P.  Elliot  (d)  patented  a  self  checlcing  answer  sheet 
in  1933  which  consists  of  a  sheet  of  paper  folded  longitud- 
inally down  the  middle  and  perforated  at  the  fold.  The 
record  side  of  the  folded  sheet  has  rows  of  numbers  corre- 
sponding to  the  test  questions,  and  laterally  spaced  per- 
forated circles  or  squares  corresponding  to  the  alternat- 
ives of  multiple-choice  answers.  The  student  tears  off  the 
perforated  circle  or  square  which  represents  his  choice  of 


(c)  Produced  by  the  Electrical  Teat-Correcter  Co., 
335  'larquette  St.   Ironwood,  Mich. 

(d)  Published  by  the  Inventor,  Manhattan,  Kans. 
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the  AQBrmv.     If  hie  choice  la  correct  a  character  Is 

Tlslhle  on  the  test  surface  below  the  opening. 

KXPSHMKHTAL  STUDISS 

The  Value  of  an  lanwdlate  Checi-up  In  Ijearning 

Among  the  first  studies  of  the  value  of  an  Immediate 
checlc-up  in  learning  la  one  by  J.  C.  Peterson  (15)  »ho 
conducted  an  experimental  Investigation  on  the  value  of 
guidance  In  learning  by  aeans  of  his  cheao-acore  Inven- 
tion previously  described.  Reading  material  froa  Wood- 
worth's  Psychology  (Revised)  was  divided  Into  three 
different  aselgwaents  accoapanled  by  appropriate  ques- 
tions. The  subjects,  who  were  divided  into  an  experi- 
mental and  a  control  group  of  equal  ability  as  rated  by 
previous  psychological  tests,  were  presented  with  the 
questions  accompanying  Assignment  A  as  a  prelinainary  ex- 
ftmlnatlon.  Thereafter  the  experimental  group  studied 
another  copy  of  the  same  list  of  questiona  with  the  aid 
of  their  text  l>oolc8  and  checked  their  answers  on  a  sepa- 
rate chemically  treated  answer  sheet  by  means  of  a  Chemo- 
pen,  while  the  control  group  proceeded  similarly  except 
that  they  used  an  ordinary  pencil  instead  of  the  self- 
•hecklng  device.  The  same  test  was  then  repeated,  after 
study,  without  the  aid  of  references  or  texts,  and  score 
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Aitfvaio»»  wv  aoU4« 

Th*  reBttlta  of  thft  experla»at  8hoi«»d  that  the  tw«nty- 
thre«  atudenta  of  th«  •acparloantal  group  gained  thp»«  Mm* 
M  aany  points  ovop  their  prollaiaftry  tost  acoro  &»  4W  tb« 
twiaty  flt«A«nta  of  %h»  ooatrol  group  audi  that  tho  dlfferane* 
ia  Wm»  av«r««a  gpttna  •*»  5.83  timaa  it«  own  atandard  error. 
Aaai«i»»Bt  B  WM  tiwa  givoii  to  the  aaaa  atuoeata  ia  * 
•iailar  faahloa,  with  the  oxoaption  that  ifti&t  had  tettn  th« 
ooatrol  group  oa  Aaai^asaaaw  A  ^oaaa  th»  oxpariaaatal  fx^np 
In  Aa»l8n"*>^^  ^«  **^  ^^^®  versa.     The  gaina  ia  favor  of  tha 
•xparlaaaial  group  agyaed  very  oloaoly  with  thoao  fooad  la 
tba  atudy  of  Aaaigmant  A. 

A  third  aaaigaaaat  naa  glvon  to  teat  tha  flaxibllity  of 
tiM  kB»vIid8»  s^iaad  aa  a  result  of  uaing  the  teatep  device. 
Ae<r>rdinsly  Aaaisaaeat  0  «aa  given  after  the  f&ahioa  of  Aa- 
sigmont  A»  differlag  only  in  the  final  teat  which  «a« 
oouelied  la  mv  %»vm  aod  preaeated  orally.     Again  the  re- 
aulta  favored  the  experiaeatal  group  with  a  dlf fereae«  la 
■•an  galaa  4.>0  tiaea  Ita  own  ataadard  error—  iadioatlag 
U^%  tte  teeter  teehnlque  ia  no  ^ay  hinders  the  iruufer  of 
lca«»Ie48e  to  aev  aituatlons  aaA  aav  problei&a, 

Xn  order  to  eeopare  the  effeetiveneaa  of  tiro  aetheds 
of  Inatruotion,   (a)  the  ordloary  writtea-lesaon  aethod  and. 
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(b)  the  self -Instructor  aethod,  B.H.  Fleenop  (6)  corwiucted 

»n  InTestlgatlon  aaong  30  pairs  of  collage  students  ^o 
were  enrolled  in  a  hoae«8tudy  cour«»  In  Psychology  at  Kan- 
sas State  College.  The  taaia  for  pairing  the  students  waa 
a  Pre-test  on  the  haslo  subject  matter  of  the  eoarae  aad  a 
Word  Relationship  mental  test« 

In  awthod  (a)  the  student  studied  an  as8i)rn!!ient  and 
wrote  answers  to  tha  objective  and  subjective  questions. 
In  method  (b)  there  was  no  written  work  what-so-ever. 
Oheiao-43core  answer  sheets  were  used  and  the  student  raads 
his  choice  of  the  objective  alternative  answers  by  press- 
ing a  needle,  talcen  froa  a  dilute  solution  of  alcohol, 
through  a  spot  on  the  chemically  treated  caird  correspond- 
ini^  to  his  conception  of  the  right  answer.  H©  was  i!!ra©- 
diately  infomed  by  a  color  reaction  as  to  the  correctness 
of  his  response.   If  he  secured  the  wrong  color  he  re-read 
and  made  another  attempt,  continuing  'ontil  he  obtained  the 
correct  answer.  At  the  end  of  each  assignment  the  eard 
was  returned  to  the  Horae-Study  Office  and  explanations  of 
questions  which  were  not  fully  understood  were  called  for. 

As  a  final  sxanlnation  for  both  courses  Woodworth's 
400  objective  questions,  based  on  his  Psychology  (Revised), 
wsre  given. 
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Th«  results  of  the  experiment  showed  that  the  eelf- 
Instructor  group  scored  a  laedlaa  grade  of  309  out  of  a  pos- 
sible 400  as  coBpared  to  288  for  the  written- less on  group. 
The  difference  hetveon  the  means  was  21,25  —  3«'6  tlses 
its  staalard  error  and  therefore  slgnif leant.  It  is  to  he 
noted  that  the  self- instruct or  group  scored  a  median  adYan- 
tage  13  points  orer  Woodworth's  own  group  at  Columbia  Teach- 
ers College. 

Fleenor  found  that  students  with  a  high  mental  test 
percentile  ranking  profited  more  under  the  self- instruct  or 
iBethod  than  did  students  with  lower  mental  test  percentile 

irahJcing. 

Se  reports  that  •'The  reaction  of  correspondence  stu- 
dents to  the  self- instruct or  method  has  been  quite  favorable, 
lanj  hawe  said  that  the  method  spares  them  of  the  tl3»- 
•oasuming  drudgery  of  writing  out  lessons  and  that  the  tise 
thus  saved  is  utilized  to  better  advantage  in  study.  These 
students  indicate  that  the  uniquez»ss  of  the  laethod  compels 
and  holds  interest**. 
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SzperliMntal  InreBtlgBtlon  of  the  Writer 

Problem,  In  order  to  ascertain  the  advantage  or  dla- 
advantage  which  aight  be  attributed  to  an  immediate  Icnowl- 
edge  of  the  rightneas  or  wrongneas  of  a  response  In  teach- 
ing, rather  than  testing,  technique,  the  writer  perforaed 
an  experimental  study  in  the  sixth  grades  of  the  Blueaont 
and  the  Hoosevelt  schools,  Manhattan,  ILansas, 

Materials  and  Method.  Pertinent,  instructive  quastloni^ 
designed  to  cover  eorapletely  two  ge(^raphloal  units,  Canada 
and  Mexico,  were  prepared  and  presented  for  the  fall  tiat 
aorssally  alloted  by  the  schools  to  the  study  of  the  vinlts. 
The  questions  were  raultiple-choice,  with  four  alternatives, 
and  so  treated  chemically  that  the  pupil  saade  his  choice  of 
the  alternatives  by  touching  a  chealcally  treated  soot  with 
his  cheiao-pen.  A  *W*  stood  out  imsiedlately  when  his  choice 
vas  wrong  and  an  *R'  when  his  choice  was  correct* 

The  34  pupils  in  the  Bluemont  Schools  studied  Canada 
with  the  check-up  questions  and,  simultaneously,  the  sasM 
unit  was  studied  without  the  check-up  questions  t>y  an  equal 
number  of  pupils  in  the  Roosevelt  Schools.   In  slailar 
fashion,  Mexico  was  studied  with  the  chec]£-up  questions  in 
the  Roosevelt  Schools  and  iTlthout  them  in  the  Bluesoat. 
Both  schools  being  oade  up  of  children  from  essentially 
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the  same  social  and  economic  background,  no  Intellectual 
differences  were  to  be  expected. 

The  regular  class-room  instructors  ^^ere  In  charge  of 
their  pupils  at  all  times  and  were  Instructed  only  in  the 
use  of  the  materials  given  and  the  standard  aodes  of  pro- 
ceedure.  At  the  completion  of  each  unit  an  objective  test, 
made  up  of  true-false,  completion,  and  niultlple-cholce 
questions,  prepared  by  a  competent,  disinterested  third 
person,  was  presented  by  the  Instructors  as  a  final  exam- 
ination over  both  units. 

Where  check-up  questions  were  used,  four  distributed 
reviews  ;7ere  provided.  The  first  review  was  executed  with 
text  books  and  reference  books  in  the  hands  of  the  pupils. 
If  they  failed  to  obtain  the  correct  response  with  the 
first  touch  of  the  Chemo-pen  they  studied  further  and  made 
another  attempt.  This  process  was  repeated  until  the  cor- 
rect answers  were  obtained. 

Shortly  before  the  end  of  the  class  period  the  papers 
were  collected  and  exchanged  for  others  containing  the 
same  questions  treated  chenlcally  in  the  same  way.  This 
constituted  the  second  r-"iew  and  was  conducted  without  the 
aid  of  textbooks.  The  third  review  was  conducted  three 
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days  later  and  the  fourth  review  at  the  end  of  the  atudy 
of  the  unit.  Saoh  day  aew  questions  were  added  and  re- 
viewed until  the  unit  ims  completed  and  the  final  exaa- 
inatlon  giren.  Pupils  irere  encouraged  to  !wep  a  record 
of  their  previous  review  scores  with  the  intention  of 

86 If -emula t 1 on. 

Results,  Conditions  which  rendered  the  results  of 
the  Mexican  unit  Incomparable  prevent  the  consideration 
cf  half  the  writer's  data.  In  the  Canada  unit,  however, 
where  controls  were  satisfactory,  the  school  eaploying 
check-up  question  technique  scored  a  niean  of  30,65*K641 
in  contrast  to  a  score  of  6?. 68t 1,37s  In  the  school  us- 
ing ordinary  class  room  methods,  ^his  leaves  a  differ- 
ence. In  favor  of  the  check-up  technlnue,  of  12,97  out 
of  a  possible  100.  Since  the  probable  error  of  the 
difference  between  the  laeana  Is  2.144,  the  difference 
Is  6.054  tla»»  Its  probable  error  and  therefore  statis- 
tically significant. 


Table  X 
OwQMrisim  of  Cheok*up  and  Hon*Ch«ck'>up  Seorea 


droup  A 

Group  B 

A-B 

■•an 
■adUn 
8taad.  Oar. 
Quartlle   i 
^artlla  2 
Quax^lla  } 
Slcawnaaa 

„,■ i 

30.645*1 .641 

33,5 
14.18 

75.25 
84.937 
20.625 
-  .603 

67.63il.378 
65.0 
H.913 
58,27 
67.18 
76.10 
.7^ 

ta, 97*2, 144 
t8.5 

16.98 

»7.757 
14.525 

An  axaslxuitloii  of  Tabia  X  will  ravaal  forthar  avl- 
4aaaa  of  tha  valua  of  tha  SjBMkliata-ohac^-up  taehnlqua. 
Xn  «canlnlng  Vsm  table  Group  A  daaignatas  tha  aohooX  ualng 
tha  lttM02c*up  quastlona  irlth  diatrlbutod  reviaira  and  G2*oup 
B  daalgnataa  %h»  aahooX  teaohlne  in  the  uaoal  eX&aaoi'ooa 
fia^loiu     It  wiXX  ba  notiead  timt  Group  A  baa  a  aadlaa 
aeora  of  33.5  aoaparad  to  65,0  Tor  Group  B  and  thai,  in 
contrast  to  the  findings  of  WXaonoTt  tha  group  of  middXa 
ability  proflta  a»§t  fro^  the  use  of  the  ahaelC'^up  quas- 
tlona,  with  tha  lover  quart  lie  i^owlng  nearly  aa  asueh  la* 
9P«raaent.     The  writer  doea  not  faaX  that  hia  diff ereneaa 
in  quart  lie  gains   justifies  the  drawing  of  ooneluaion»» 


rr 


tat  i0  dm9  wun  io  •tai*  itei  ^rota^Uy  Ui*  ••tf^oiuMklas 

^19  tr?^   of  Gtl»8ti9r»,   tOf«tll«P  vltH  th«  iMUttliflS  JffBIHiift 

iNMd,  will  d*tovtaizt»  3lasv«  tbft  aAZlami  •dfaatoft  irlll  faU. 
fte  »•■<»•  of  afetwiiMt  for  tlMi  distribution  untw  «f 
Um  t«e  erovp*  la  pRrtleularXy  atmifloant  slnoo  both  aM 
dMtiffdlj  ftkvwNl  In  OMWtlt*  dlpofttioiis—  craop  A  taloe 
•lnnr»d  to  th»  Melit  aoA  apou?  B  to  the  loft.    This  t^imm 
tluit  ilM  tost  ^Hisli  «M  too  oasf  for  Greis?  A  «m  too  dir« 
f Unit  for  Groa»  9  oai  tlMit  tM  toot  shoBU  9«^»orljr  Imvo 
ittolwflort  mof  •maf  ftml  aoro  difficult  Qoostloao*-  ladloot* 
Urn  Mk»  diffloalty  of  rmklx^  a  oli^lo  tost  voll  flttod  for 
tath  i^rmips.     FMm  an  osattlnatlon  of  tho  eunro  o^vnoss,  it 
is  to  bo  Inforrod  that  had  tho  final  tost  hoon  aio^aato  tho 
aorits  of  tho  ohook««i»  ^uootioa  toofahi<aiio  mmlA  havo  boon 
aors  oienifioaat  than  tho  difforonoos  rovoal. 

wfMXJuaion  or  GmcK*wf  isncss 

It  has  hooa  pointod  out  that  maa^  tiao  ooold  ho  o«fod 
tho  toaaiMt*  hj  tho  oai^lofaontt  of  oortain  tasting  and  ooor* 
iag  d«vioos  vhloh  aro  aoo  availahlo*  vith  tao  porfo^sowro 
dovioo.  for  o«oi9lo»  it  is  poosihlo  to  iooro  75*300  ««• 
oooro  por  hour  vithout  aiotaleot  aaft  with  tha  aalti^^la 


perfoi?ator,  to  score  over  a  half-million.   It  Is  also  pos- 
sible to  score,  aari  correct  answers  and  st&ap  scores  upon 
&  lOJ-itea  answer-sheet  in  approxinjately  seven  seconds  with 
the  Blectro-Score  machine  previously  described. 

That  such  labor-aavlxig  devices  are  sound  psycholog- 
ically and  educationally  is  evident  froa  an  examination  of 
the  results  of  experixental  studies  which  have  employed 

thea.  Thomdike  (2?)  states  that  "When  a  person 

learna  the  response  by  anticipation  and  confirmation,  it 
is  likely  to  fora  a  sure  meaorj."  Such  is  precisely  the 
technique  of  the  laaediate  check-up.  While  the  interest 
of  the  student  in  the  question  before  hia  is  at  white  heat 
he  learns  the  correctness  or  the  incorrectness  of  his  re- 
sponss.  By  continuing  his  efforts  until  the  right  answer 
is  obtained  he  experiences  satisfaction  and,  according  to 
the  law  of  effect,  strengthens  the  proper  connections. 

It  is  interesting  to  consider  how  an  iaraediate  check- 
up provides  for  the  opsration  of  Thorndike's  other  laws  of 
learning.  Consider  the  law  of  exercise:  since  the  correct 
responses  are  the  only  ones  which  allow  a  pupil  to  proceed 
to  the  succeeding  questions,  it  follows  fron  aatheaatical 
probabilities  that  the  correct  responses  receive  the  aost 
exercise  and  consequently  that  their  connections  are 


9tww^Vbm0d  aoat.     FinaXIj,  eonsldoring  tlM  lav  of  r«eea- 
«y.  It  nay  wadlly  be  ii«9n  thja,t  tl»  correct  aM»wr  1»  al- 
najfl  tb*  Boat  xveent  aiui««Pt  ^^^  aftoi*  it  la  obtalnod,  and 

not  before,  the  pupil  proceeds  to  the  next  question. 

TH8  FOTURK  OP  SSt,F-Ca»OKIJIB  DI5YICS3 

7o  th«  vrlter  it  M«aa  that  testlne  and  aeorlng  de- 
Tleea,  particularly  those  providing  for  an  laaediate  oheek« 
up  on  the  accuracy  of  reaponses,  -^lll  gradually  but  forol- 
bly  prosa  their  obsolete  ©oapetltors  froa  the  field  of 
learalne-     As  the  great  aaas  ©f  edueatora  learn  that  such 
educational  Instruaoats  are  not  only  avRllablo  but  practic- 
able, econoaleal,  and  eduoatlonally  deslr^ible,  they  will, 
of    v  oertalnty,  naJce  use  of  the  aids,     ^y  so  doing,  a  new     ^B 
iapetus  will  be  giTen  to  furtixor  te^i  developsaent  and 
education  will  profit  treaendously. 
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